Papers with MDLSTM layer
Towards Two-Dimensional Sequence to Sequence Model in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Existing models treat source and target sentences as one-dimensional sequences over time, while a 2D mapping is achieved using an MDLSTM layer. |
| Approach: | They propose a multi-dimensional long short-term memory architecture for translation modelling that uses an MDLSTM layer to define the correspondence between source and target words. |
| Outcome: | The proposed model improves on two WMT 2017 tasks, showing that the source and target sentences are aligned with each other in a 2D grid. |